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SUMMARY 


This  is  a  survey  of  problems  and  recent 
developments  in  some  selected  areas  of  nonparametric 
reliability  theory.  The  paper  is  divided  into  three 
parts:  Models  for  Life  Distributions,  Tests  of 
Hypotheses,  and  Estimation  Procedures. 
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SOME  RECENT  DEVELOPMENTS  IN  RELIABILITY  THEORY 


Richard  E.  Barlow 


1. _ MODELS  FOR  LIFE  DISTRIBUTIONS 


Reliability  theory  is  largely  concerned  with  questions  about  coherent 
structures,  i.e.,  structures  which  can  be  represented  as  combinations  of  various 
series  and  parallel  networks  (allowing  the  possibility  of  component  replication) . 


Various  attempts  have  been  made  to  delimit  the  class  of  life  distributions  of 
interest  for  such  structures.  Extreme  value  theory  provides  an  answer,  in  part,  to 
the  question:  Given  a  coherent  structure  with  a  finite  number  of  components  and 
some  procedure  to  increase  the  number  of  components  without  bounds,  what  are  the 
possible  limiting  distributions  for  the  structure  lifetime  for  given  component 
lifetime  distributions?  A  series  structure  has  a  lifetime  corresponding  to  the 
minimum  of  its  component  lifetimes  and  the  limiting  procedure  adds  one  component  at 
a  time  to  the  structure.  The  only  possible  relevant  limiting  distributions  for 
this  case  are  the  Weibull  and  double  exponential  distributions  [12],  If  we  add 
k-out-of-n  structures  to  the  structures  of  interest,  we  obtain  the  normal  and 
lognormal  distributions  and  distributions  of  the  form 


Ga,k(x)  ■  0 


for  x  <  0 


A 

~ YJT  j  e  ^dy  for  x  >  0  ,  a  >  0 


Vx)  ■  or 


e 

1  C  -y  k-1 

”  J  6  y  c 


-OO  <  X  <  00 


[8],  [27].  Results  for  more  general  models  have  been  obtained  by  Harris  [14]. 
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There  is  a  vast  literature  concerned  with  the  estimation  of  parameters  for 
distributions  in  these  classes.  For  a  recent  comprehensive  survey  of  results  for 
the  Weibull  distribution,  see  Mann  [18]. 

We  might  call  the  preceding  approach  "the  limiting  distribution  approach."  A 

more  recent  approach  to  delimit  the  class  of  life  distributions  of  interest  has 

been  to  start  w'th  the  exponential  distribution  and  to  ask  the  question:  What  is 

the  smallest  family  of  life  distributions  containing  the  exponential  distribution 

which  is  closed  under  the  formation  of  coherent  structures  and  limits  in 

distribution0  This  question  was  recently  answered  by  Birnbaum,  Esary  and 

Marshall  [5].  The  class  of  distributions  in  question  is  precisely  the  class  with 

t 

increasing  failure  rate  on  the  average  (IFRA  distributions),  i.e.,  S  r(x)dx/t  is 

0 

nondecreasing  in  t  0  where  r(t)  is  the  failure  rate  function.  Research  on 
estimation  procedures  for  IFRA  distributions  md  tests  of  hypotheses  concerning 
such  distributions  is  still  underway  [3],  [9],  [10]. 

A  great  deal  of  attention  has  been  focused  on  models  for  life  distributions 
based  on  properties  of  the  failure  rate  function.  For  example,  we  could  consider 
the  class  of  distributions  having  failure  rate  r(t)  for  which  r(t)/\p(t)  is 
increasing  (or  convex  increasing)  for  specified  iji(t)  >  0  .  If  ih ( t )  is  constant, 
we  have  the  class  of  IFR  (for  increasing  failure  rate)  distributions.  The  case  of 
more  general  4>(t)  has  been  investigated  by  Saunders  [26]  in  connection  with 
models  for  fatigue  failure. 

Some  multivariate  models  have  been  proposed  to  describe  the  joint  lifetimes  of 
components  in  a  coherent  structure.  The  multivariate  exponential  distribution 
studied  by  Marshall  and  Olkin  [19],  [20]  generalizes  the  univariate  exponential 
distribution  in  a  natural  way.  Harris  [35]  has  proposed  a  class  of  multivariate 
distributions  with  IFR  marginals  which  satisfy  additional  reasonable  restrictions. 
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Esary,  Proschan  and  Walkup  [11]  study  a  new  concept  of  positive  dependency 

describing  the  joint  lifetimes  of  components  in  a  coherent  structure.  They  say 

that  random  variables  T,  ,T„ . T  are  associated  if 

12  n 

Cov[f (T) ,g(T) j  >  0 

for  all  nondecreasing  functions  f  and  g  where  T  *  (T^.T^,  ....  T  )  .  Random 
variables  jointly  distributed  according  to  the  multivariate  exponential 
distribution,  for  example,  are  associated.  This  concept  is  partly  motivated  by  the 
idea  that  working  components  tend  to  reinforce  the  contribution  of  each  other  to 
system  performance.  Stated  in  another  way,  a  failed  component  may,  if  anything, 
stress  the  remaining  working  components  so  as  to  cause  them  to  perform  poorly. 

Also,  components  subject  to  a  common  environment  tend  to  be  associated.  They 
obtain  lower  bounds  on  system  reliability  in  terms  of  component  marginal  reli¬ 
abilities  when  components  have  associated  lifetimes.  Lehmann  [17]  considers 
related  ideas  of  positive  dependency  for  the  bivariate  case  and  examines  tests  of 
independence  versus  positive  dependency. 
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2.  TESTS  OF  HYPOTHESES 

Considerable  attention  has  been  focused  on  the  problem  of  testing  the  validity 
of  the  IFRA  and  IFR  models  [1],  [3],  {24].  The  problem  usually  posed  is  that  of 
testing 

Hq  :  F  exponential 

versus  (1) 

H  :  F  IFRA  (or  IFR). 

-Xx  -1 

If  G(x)  =  1  -  e  for  x  _>  0  and  X  >  0  ,  then  G  F(x)/x  is 

nondecreasing  in  x  _>  0  if  and  only  if  F  is  IFRA.  This  observation  suggests 

that  -’e  consider  the  following  partial  ordering  on  the  space  of  life  distributions; 

namely,  F^  <  if  F^F^xJ/x  is  nondecreasing  in  x  ^  0  .  Note  that 

F  <  F„  <  G  suggests  that  a  test  for  (1)  should  have  greater  power  at  F^  than  at 

F2  no  matter  what  significance  level  we  choose  for  our  test.  Marshall,  Walkup  and 

Wets  [22]  have  characterized  the  class  of  differentiable  test  statistics  which 

produce  tests  having  monotone  power  with  respect  to  <  ordering.  These  are  just 

>v 

the  tests  based  on  functions  h(x.,x„,  ...»  x  )  having  the  properties: 

1  /  n 

(a)  h  is  homogeneous; 

j  3h(x  ,  ....  x  ) 

(b)  )  x  - r -  >_  0  for  j  =  0,1 . n-2 

i-0  n_1  n-i 

and  all  0  <  x,  <  x„  <  . . .  <  x  .  The  test  associated  with  h  would  reject 
—  1  —  Z  —  —  n 

exponent iality  if  hCX^X^  ...,  Xn>  ^c  where  c  is  some  suitable  critical 

number  and  0  <  X,  <  X„  <  ...  <  X  are  order  statistics  from  F  .  For  example, 

—  1  —  Z  —  —  n 

^  2  2 

h(Xx . Xn)  =  V  (Xt  -  X)  /(X) 

n 

where  X  =  )  X^n  is  such  a  function. 

,  i 
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Let  n(u)  equal  the  number  of  items  exposed  to  risk  at  time  u  and 
Xi 

T(X.)  -  f  n(u)du  .  Tests  based  on 

1  r\ 


h(X. . X  )  -  l  A  T(X. ) /T(X  ) 

l  n  ll  n 


for  A  >  0  are  unbiased  and  have  monotone  power  with  respect  to  <  ordering. 

1  * 

These  tests  reject  exponentiality  in  favor  of  IFRA  for  large  values  of 

MX^^,  ....  X^)  .  This  statistic  has  a  natural  analogue  for  the  case  of 

incomplete  data  [2].  The  corresponding  test  remains  unbiased  but  we  can  no  longer 

prove  that  it  has  monotone  power  with  respect  to  <  ordering. 

* 

Tests  based  on  (2)  have  been  extensively  studied  by  Bickel  and  Doksum  [3]. 
They  call  such  tests  studentized  linear  spacings  tests  and  consider  the  following 
"pencils"  of  alternative  densities  to  the  exponential: 


ff1}(x)  *  [1  +  0(1  -  e  x)]  exp{-[x  +  6(x  +  e  x 


fp^(x)  *  (1  +  0x)  exp{-(x  +  ^Gx2)} 
0 

fp}(x)  ■«  (1  +  0)x9  exp{-x(1+0)} 
fJA)(x)  -  [x6e"X]/r(l  +  0) 

r 


(Linear  Failure  Rate) 


(Weibull) 


(Gamma) 


For  each  density  x  0  ,  0  _>  0  ,  and  the  null  hypothesis  is  obtained  for  0  =  0. 

The  asymptotically  best  studentized  linear  spacings  test  against  ff^  corresponds 

to  weights  A^  ■  1  (i  *  1,2,  n-1)  .  This  statistic  is  also  called  the  total 

time  on  test  statistic.  The  asymptotic  Pitman  efficiency  of  this  test  compared  to 

the  asymptotically  most  powerful  test  for  this  reduced  problem  is  only  h.  However, 

there  is  a  great  deal  of  evidence  supporting  the  "robustness"  of  this  test.  The 

(3) 

asymptotically  best  studentized  linear  spacings  test  for  fQ  — the  Weibull 

density — seems  to  be  a  robust  competitor  to  the  total  time  on  test  statistic.  They 
also  consider  the  corresponding  asymptotically  best  linear  rank  tests  which  are 
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asymptotically  equivalent  to  the  best  linear  spacings  tests.  However,  the  Monte 
Carlo  power  of  the  asymptotically  best  linear  spacing^  tests  is  much  superior  for 
small  sample  sizes. 

The  Monte  Carlo  power  of  the  total  time  on  test  statistic  is  computed  in  [1] 
against  the  likelihood  ratio  test  for  truncated  exponentiality  versus  IFR 
distributions.  Again,  the  total  time  on  test  statistic  seems  to  be  decidedly 
superior. 

In  [28],  van  Soest  studied  an  omnibus  Cramer-Von  Mises-Smirnov  type  of 
statistic.  The  statistic  is 


00 


where  is  the  empirical  distribution  and  F  is  the  maximum  likelihood  estimate 

of  F  under  Hq  .  The  null  hypothesis  is  rejected  for  large  values  of  C^  .  He 

computes  the  Monte  Carlo  power  of  this  test  and  compares  it  with  a  two  sided  test 

based  on  the  total  time  on  test  statistic.  The  power  curves  below  compare  this 

test  with  the  one  sided  test  based  on  the  total  time  on  test  statistic  (2). 

Doksum  [10]  has  recently  investigated  the  two  sample  problem  for  IFRA 

distributions.  Let  X.,X-,  ....  X  and  Y1tY_,  ...,  Y  be  two  independent  random 

i  z  n  i  /  n 

samples  from  populations  with  continuous  IFRA  distributions  F(*)  and  F(*/A)  , 
respectively,  and  let  s^,  denote  the  ranks  of  the  Y's  in  the  combined 

sample.  For  testing  Ho  :  A  <_  1  versus  :  A  >  1  ,  it  is  shown  that  the  error 
probabilities  of  each  monotone  rank  test  $  are  bounded  b^  the  error  probabilities 
for  exponential  alternatives,  i.e.,  if  G(t)  *  1  -  exp(-t)  ,  t  0  ,  then 


P[reject  Ko  ]  F(>)  ,  F(  - /A)  ]  <_  P[reject  Hq  |  G(')  ,  G  ( *  /A)  ] 


POWER  CURVES 


Tl:  Total  Time  on  Test - N  ■  10  W:  Weibull 

T2 :  C  Test  - N  =  20  G:  Garmna 

n  L:  Linear  Failure  Rate 


0.00 


2.00 


I 

I 


for  A  <  1  ,  and 


Pfaccept  |  F(*)  ,  F(-/A)]  <_  P[accept  Hq  |  G(*)  ,  G(*/A)] 


for  A  >  1  . 


The  Savage  test  which  rejects  for  small  values  of 


n  N 

S  =  \  J  (s  )  where  J  (k)  =  \  — 

N  i=i  °  1  °  j-Nii-k  J 


(N  *  m+n) 


is  locally  minimax  for  IFRA  scale  alternatives  within  the  class  of  rank  tests, 
the  two  sample  problem  with  indifference  region,  i.e.,  :  A  <_  1  versus 

:  A  _>  A^  >  1  ,  the  Lehmann  test  which  rejects  for  small  values  of 


N  f  (A  -  1)  1 

108  [J '  ~h~  sjJ 


where  s^  is  the  number  of  Y's  greater  than  or  equal  to  the  (N+l-j)th  order 
statistic  in  the  combined  sample,  is  minimax  at  A  =  A^  within  the  class  of  rank 
tests  for  IFRA  scale  alternatives. 

In  an  earlier  paper  [9],  Doksum  considers  the  asymptotic  efficiency  of  the 

best  test  for  exponential  models  relative  to  the  Savage,  ,  test.  For  the 

* 

exponential  distribution,  the  uniformly  most  powerful  level  a  test  4^  of 
Hq  :  A  =  1  against  :,A  >  1  rejects  when 


T  =  m 


IU  ,  U 

l  X./n"  y  Y  >  F„  _  (a) 
i=l  1  i=l  1  2m»2n 


where  F„  „  (a)  is  obtained  from  the  tables  of  the  F  distribution  with  2m  and 
2m,  2n 

2n  degrees  of  freedom.  Doksum  considers  the  modified  test  4>  so  as  to  have  an 
asymptotic  level  a  test  when  the  distribution  is  IFRA  and  not  exponential.  The 


test  J>  reiects  H  for  large  values  of 

O 

NS(T  -  l)/(o/u) 


where 


and 


The  efficiency  of  the  Savage  test  with  respect  to  <J>  goes  from  1  to  «>  as 
shape  parameter,  b  ,  of  the  Weibull  distribution,  G(t)  =  1  -  exp[-Ub]  ,  goe 
from  1  to  °°  (or  from  1  to  0)  .  He  also  treats  the  case  of  censored 


sampling. 
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3.  ESTIMATION  PROCEDURES 

The  failure  rate  function  is  perhaps  the  most  useful  chnrac terizat ion  of  a 
life  distribution.  Parametric  and  nonparametric  methods  for  estimating  the  failure 
rate  are  discussed  in  detail  by  Grenander  [13].  He  also  characterizes  the  maximum 
likelihood  estimate  (MLE)  of  the  failure  rate  function  under  the  IFR  assumption. 

The  MLE  can  be  easily  computed  even  for  very  incomplete  data  (withdrawals  may  be 
allowed  for  example).  If  a  total  of  n  items  are  exposed  to  risk,  failures  are 
observed  at  times 


7. 


1 


< 


Z 


k 


(k  <  n) 


and  n(u)  is  the  number  of  items  exposed  to  risk  at  time  u  ,  then  the  MLE 
estimate  for  the  failure  rate,  r(t)  ,  can  be  expressed  as  a  step  function,  where 


0  '  t  <  Z 


1 


r(t)=<r(Z.)  Z.  <  t  <  Z 


n  i 


l  — 


i+1 


C  -  Zk 


and 

r  (Z  . )  =  Max  Min 
n  l  .  .  .  . 

s<i  t>i+ 

Marshall  and  Proschan  [21]  proved  that  r^(t)  is  strongly  consistent  in  the 
complete  sample  case.  Since  the  life  distribution  is  determined  by  the  failure 
rate,  we  can  also  determine  the  MLE  for  the  life  distribution  under  the  IER 
assumption.  Monte  Carlo  investigations,  however,  indicate  that  it  is  badly  biased 
in  the  tails.  For  samples  of  size  100  or  so,  the  empirical  distribution  appears 


to  be  a  better  estimate  of  the  life  distribution  in  the  tails. 
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Rao  [25]  has  characterized  the  limiting  distribution  of  r^Ct)  assuming  r(t) 
increasing  and  r'(t)  >  0  .  He  shows  that 


where  H(x)  is  a  distribution  whose  density  is  determined  implicitly  as  a  solution 
to  the  heat  equation.  This  result  enables  us  to  make  asymptotic,  efficiency 
comparisons  with  other  nonparametric  estimators  of  the  failure  rate. 

Parzen  [23]  and  Weiss  and  Wolfowitz  [30]  investigate  window  estimators  of  the 
density  f(t)  ,  i.e., 

f  (t)  *  N/2ne 
n  n 

where  N  is  the  number  of  observations  out  of  a  sample  of  size  n  in 

r  -  e  ,t  +  c).  If  c  =  na  and  we  assume  only  that  f'(t)  exists,  then 
n  n  n 

Weiss  and  Wolfowitz  show  that  a  =  1/3  provides  an  asymptotically  efficient 
estimate  in  a  certain  sense.  A  natural  nonparametric  estimate  of  the  hazard  rate 

is  then 
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define  the  asymptotic  efficiency  of  rn(t)  relative  to  r^(t)  as 


e(?n<f),r„(0) 


(3) 


where  a  satisfies 
o 


inf  d{  <$(x)  ,H(x/o)  ]  =  d  [<J>(x)  ,H(x/oo>  ] 
o 


and 


d[ <S>(x)  ,H(x)  ]  *  sup  |«(x)  -  H(x)  |  . 

— ^><x<a) 

-1/3 

In  this  computation,  we  have  let  *  n  for  the  window  estimator.  It  seems 

clear  from  (3)  that  the  MLE  estimator  will  do  best  when  r'(t)  -  0  and  the  window 

estimator  will  be  better  when  r'(t)  is  very  large,  or  in  othe;  words,  when  the 

failure  rate  is  increasing  very  rapidly. 

Since  r  (t)  is  not  necessarily  increasing,  a  more  acceptable  competitor  to 
n 

r  (t)  under  the  IFR  assumption  would  be 
n 


r 

n 


(ti> 


=  Max  Min 
s^i  w>i 


w 

l 

r  (t.) 

1=s 

n  j 

w  - 

s  +  1 

which  is  nondecreasing  in  t^  .  (0  <_  t^  <_  t2  <_...<_  tR  <_..  .  are  midpoints  of 

intervals  over  which  the  window  estimator  is  constant.)  The  results  of  Brunk  [7] 

show  that  r  (t)  will  inherit  the  consistency  property  of  r  (t)  and  will  improve 
n  n 

on  r  (t)  in  a  least  squares  sense, 
n 
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Similar  nonparametric  MLE  estimates  for  U-shaped  failure  rate  lunctions  have 
been  considered  by  Bray,  Crawford  and  Proschan  [6].  There  is  a  very  useful 
general  smoothing  technique  behind  all  of  these  estimates.  Brunk  [71  has  observed 
that  r^CZ^)  ia  t*ie  "isotonic  regression"  on  the  index  i  of  the  sequence 

*  fi+1 

rn(Z^)  *1/1  n(u)du 


with  respect  to  a  suitable  measure,  namely. 


u { i} 


n(u)du 


in  this  case.  The  isotonic  regression  r^Z^)  has  a  useful  least  squares 

property;  namely. 


n  A  I"  *  r 

Jj  [r„(zi>  -  “(l» 

n-l  r  *  .  2 

i  lml  [r  <V  -  r„<zi>J  “{l) 


+  X  [W  ‘  r(Zl,]2“U) 


holds  for  every  increasing  function  r(Zi)  . 

To  illustrate  another  use  of  the  isotonic  regression,  consider  the  following 
estimation  problem.  Suppose  that  items  are  inspected  at  random  times  and  that 
failure  is  observed  only  through  inspection.  Our  failure  data,  on  each  item  which 
falls,  consists  of  intervals  (t^,t^+^)  where  it  is  only  known  that  the  item 
survived  to  time  t^  and  failed  sometime  in  the  interval  (t^.t^^)  .  Harris, 
Meier  and  Tukey  [16]  study  the  MLE  estimate  of  the  failure  rate  under  these 
conditions.  The  approach  is  nonparametric  in  that  it  is  assumed  only  that  the 
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failure  rate  is  constant  (but  unknown)  over  specified  time  intervals.  The  fact 
that  the  authors  seek  rates  rather  than  probabilities  for  intervals  produces 
certain  differences  in  their  treatment  of  observations  extending  over  parts  of 
intervals  as  compared  to  the  "actuarial"  treatment.  The  isotonic  regression 
technique  can  be  applied  to  the  Harris,  Meier,  Tukey  estimate,  for  example,  if  we 
assume  that  the  failure  rate  first  decreases  and  then  increases. 

Let  0 .  denote  the  Harr is-Mei er-Tukey  MLE  of  the  failure  rate  in  interval 
i  .  Let  (0,1)  denote  the  first  interval;  (1,2)  the  second  interval,  etc. 
Suppose  the  MLE  looks  as  follows: 


To  obtain  an  estimate,  say  o  ,  which  decreases  and  then  increases  and  which 
is  closest  to  p  in  a  least  squares  sense,  proceed  as  follows: 

(1)  Choose  in  turn,  i^  =  0,1,2,  ...,  n  for  possible  change 
points  of  the  failure  rate. 

(2)  Suppose  i  =  0  .  Then 

o 


p  . 
J 


Min 

v>l 


V  +  1 


1 


and 


=  Min  Max 
v>i  u-"i 


-1=u 


v  +  1  -  u 


(3)  If  0  <  i  <  n  ,  then 
o 


(3a) 


Max 

i  -l>v>i 
o - 


Min 

u<i 


v 


v  +  1  -  u 


for  1  <  i  <  i  -  1 
—  —  o 


and 


(3b) 


Min  Max 

v>i  i  <u<j 
—  o - 


v 


v  +  1  -  u 


for  i  <  i  <  n  . 
o  — 


(4)  For  each  choice  iQ  ,  compute 


(5)  Take  as  your  estimate  that  p  .  corresponding  to  the  change 

i,1n 


point  which  minimizes  the  sum  of  squares. 


It  can  be  shown  that  the  estimate  p.  .  so  obtained  is  closest  to  the 

. 

Harris-Meier-Tukev  estimate  d  in  the  sense  that  it  minimizes  the  sum  of  squari 
errors  relative  to  all  competing  estimates  which  first  decrease  and  then  increase 
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